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ABSTRACT 


A description is given of hm edges of prismatic objects appear 
through a television camera serving as visual input to a computer. 
Two types of edge- finding predicates are proposed and compared,, 
one linear in intensity, the other non-linear, A statistical 
analysis of both is carried out, assuming input data distorted 
by a Gauaaifin noise- Both predicates have been implemented as 
adge-verifying procedures, i.e. procedures aiming at high sensi¬ 
tivity and limited to looking for edges when approximate location 
and direction are given. Both procedures have been tried on 
actual scenes. Of the two procedures the non-linear one emerged 
as a satisfactory solution to line- verification because it performs 
well ill spite of surface irregularities- 
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IHTRDDUCTIQH 


The task of tocbpvtetf vision is defined as fellowsi 

A television camera s the vidisaector, scans a visual 
scene, consisting of three-dimensional objects. The 
camera is connected to a computer* and an array of numbers 
f^presenting the light intensity distribution is entered 
Into the memory of the machine. Our goal la, using this 
information, to separate and identify the objects in the 
scene- 

That visual perception can be accomplished by reducing the 
originally multidimensional information to the set of discontinuity 
lines y is amply confirmed by our ease at recognizing objects in 
line-drawings. There are many soft-curved objects in our world; but 
even then, the outline together with a few lines along the maximal 
curvatures, constitute a good representation, of the object, for 
recognition purposes. It is thus natural that coraputEr vision should 
start with line detection. 

The difficulty of boundary detect ion lies in part in the 
nature of our detector, which provides with a set of set bf 
dieitized . noisy light intensities at discrete locations. 




Sut the difficulty lies above all in discriminating surface strueCure 
from actual edges. In addition we must proceed in a reasonable amount 
of computing time. 


The worlc in this thesis consists of three main parts: 

1) an investigation of the nature of the world as seen through 
our input devices. 

2) the definition of a boundary detection procedure proficient in 
the following situation: presence of a Gaussian detector noise snd 
surfaces of uniform texture except for the presence of tbtb defects 
of small diameter. 

3) Finally the detection method has been concretely worked out In a 
"line verifying program"; i.e, we assume that we know approximately 
the location and direction of the edge and ue aim at a very high 
sensitivity, the price of which ia reflected in a computing time 
too large for general purpose use.This defines a partial problem 

Of line detection, justified by the overall conception of the vision 
system at Project MA.CJ i + e* our program is to be used only locally, 
in critical cases of "elusive 11 edges, under call of a higher level 
procedure, which looks for evidence that in some area, a less sensitive 
but faster procedure bas missed, a line. 
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RISTO-RTf OF THE PROBLEM 


In the beginnings of Computer vision* the following Lot*! ptedi- 
cate was used: 

A point to Likely to belong to a boundary If the following 
condition is fulfilled: any one Or both of the differences 
between the light intensity at it and at its horizontal and 
vertical neighbors are greater than a given threshold! 

{see Roberts,l9B3; his predicate is a variant Of the above-} 
However this simple idea soon proved itself UhSvffit lent + It is 
successful in the Very limited case- of surfaces of excellent homo¬ 
geneity and with a high contrast between the regions 'limiting the 
edge, Otherwise any choice of value for the threshold will either 
give as boundary points any surface irregularity, or report as uni¬ 
form areas where an edge Ilea. 

* Coincidences Fredicetea 1 fT.Linford) constitute ft fair improve¬ 
ment. Instead of a single large Intensity difference one requires the 

occurrence of a pair of them. In parallel: i.e ► if I denotes the 

i i J 

Light Intensity at the lattice point the differences 

(I t,j * "i+i.j 1 “ J (1 i,]+i * l i«,)+i J be both 1,1,68 

and the same sign ( Or alternatively (I. j - j+i^ aci ^ 

(I * . * I. , 411) )■ actual predicate is a somewhat morb 

i+i p j i+l*j+l 

complex elaboration* and! improvement bf the easne principle* 


This criterion wi 11 clearly be harsher on Tandom perturbations 
than the preceding one. But true boundary paints will pass through 
because an actual line 1 extends along its awn direction 

With the additional noise filtration gained through the kind 
of line-fitting method which attempts to find an accumulation 
of boundary points along a line,. this constitutes a reasonably good 
technique for general purpose use* it is economical in time and 
discriminates somewhat against surface defects. But it is limited 
in aensitivity {it usee for its decision the evidence of a 
email set of points, thus preventing the statistical law of large 
numbers to play very much in our favor by making us converge toward 
the underlying noiseless distribution). At least on some small subparts 
of the image* we need to do better- 

In ' operator which locates- edges in digitized pictures 1 
(Haeckel- 1969 ), an 'edge operator 1 is proposed, which accepts all 
brightness values within a small disc-shaped subarea of the picture; 
it then applies to them a low-pass filter which singles Out 3 Luw- 
order Fourier components { wavelengths of order the diameter of the 
disc); sotne of the white noise, whose spatial frequency is higher is 
thus eliminated, but also soi&e useful information. It will, then atterspt 
to fit to the trar.sformed distribution an ideal noiseless brightness 
Step. An elegant mathematical solution yields the location and ampli¬ 
tude of the best fitting step. If the amplitude is large enough, it 
is inferred that an edge effectively passes over the disc- 
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The operator appears to be reasonably East and EG have a line 
resolution; although the paper doea not include any discussion of the 
sensitivity, our evaluation of its lower limit showed that it was not 
sensitive enough for our needs. It does not provide for edges yielding 
a light intensity surface other than a step separating two horizontal 
planes; we will see that often this is not sufficient. 

Griffith (P.H.D, thesis: in preparation) Is working toward a 
"Theory of the optimal use of intensity information in the detection 
of lines in the visual field" r + Optimality is defined under the follo¬ 
wing set of conditions; 

(i) The i scanning patternnamely the set of points 4t which 
brightness measurements are taken is fixed; i»C» no additional 
information about the picture c*n he obtained is the course of the 
procedure* 

(it) The noiae is Causetan. Surface defects are not taken in 

account. 

(ill) The procedure is uniform with respect to position and 
orientation. 

(iv) The s-priori probabilities of the presence of lines 
&?£ known. 

Fe do a somewhat more realistic treatment but a theoretical epptoach 
with these simplifying assumptions la of great interest. 
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PRELIM! KAR¥ STUDIES 

WHAT THE WORLD LOOKS LIKE THROUGH OUR INPUT DEVICES 

X ifai-liJftL-lnfciailfca anitt 

The. i tit erf see between vldissector and computer yield* numbers which are 
logarithms of the light intensity . Calibration of the measure apparatus 
has given the following result; 


Adding 96 to the logarithmic measure correspond* to division by a 


factor of 2 of the actual light intensity. 


We will in the reat of this thesis call these unite vidian units or v.u. 

1 IhmaiaB 


a) Its sources can be traced to 4 phenOttaita. 


i> Photon noise 

Measuring the light intensity is done by measuring the time taken for a fixed 
number N of photons to hit a photosensitive device. The light intensity* I* is 
inversely proportional to that time. The number of photons arriving during 
jtucovS&ive equal Intervals of time t, show a Poisson distribution* which for 
Large numbers, can he approximated by a normal distribution of mean, say N, 
and standard deviation 5 n “ |b". With a good approximation* if for a given in- 
tensity H photons arrive, in a time t on average ■ then if It is the deviation 


on time; 



As N is kept constant through all Our measurements, £t retrains constant 


t 


whatever the intensity and so is ll ^ Xt - Thus* t£ D - Log I* 5 l is a 

I t 

constant; £.e. expressed in L og arithmic units, the photon noise remains the 
same for any intensity level- 











ill . Hot&-B.. JLl zc tronics 


Very licet e ia known about it- In any esse it cannot be be pa¬ 
rad'd £s*asn the. above source of noise. 

iii) Ribplc- o£ the Lfflt 

The sun gun lamp which wo used had a large amount o£ 120 cycle 
noises of which wo became aware only recently s so that all the ejtpe- 
riments described in the thesis were carried out without any protec¬ 
tion against It- We now use photocathoda reference for the measure¬ 
ments i-e- normal ire by the average photocathede i llu-mi nation- Small 
lamps ere particularly noisy because they have smell filaments- We 
are about to try supplies for the lamps - 

iv) Inhornoaeueltv of the photocathode 

The sensitivity of the cea su if ament a by the vidissector varies 
from one point of its field to another. 

b) A measurement of the effective standard deviation 

We want a measure of the noise which accounts for all the above 
factors- As we will sec* our detection functions always involve a 
comparison of nearby values of the intensity- Thue a first approsi- 
mation to the thresholds to use for testing the presence of edges* 
is based on a value of the standard deviation accounting for the 
spatial inhoEogeneity of the sensitivity of the vidiasector- 

After having defocussed in order to have a surface with good 
homogeneity* we scanned a sheet of while paper, first horizontally 
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■and then vertically, and at each p el Lit we. took the following rueaau-" 
renientr the difference between the average of 15 brightness valves 
on e segment centered around the point and the value St the point< 

The suit of the squares of these was averaged over the whole 
screen and the square root of the result is the required standard 
deviation. We found a value 

£l ■ 1.2 v.u. 

As a guide for fixing thresholds, we worked according to the 
approximation that the overall noise was Gaussian, All the errors 
can be expected to he proportional to the intensity end therefore 
the logarithmic error ia constant. 

1 .SuiLfsj.e, .structure of the objects- 

Wo have not dealt with texture but only with sparse surface 
irregularities of small diameter i-e, covering around 1% of the 
surfaces. In fact we were successful with surfaces considerably 
worse than we were expecting to use; several scenes (see figures 
27 h 2d and 29 ■ ) contain Objects Which Were Chosen to be very 

bad; they showed & lino at wood texture end a pebbly texture of end- 


grain* 
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4 Light intensity ,dlat 

In tensity profiles taken along straight lines on planes showed much 
larger gradients than we expected. The phenomenon was investigs ted t 
both theoretically and erper itfienta lly* 

The intensity varies essentially because the light source induces 
a cion-uniform intensity on the object. As Appendix I shows, with a Loga- 
rithmlc measure of the intensity, the gradient of the reflected Light 
at the object and the gradient at the image are the same, to a second 
order approximation. Thus we will now consider the 


(i) Variation of the lieht intensity on g plane in .pjt^e.pp.e ,a EajLnt 

Light so.utcs . 



which intersects the plane of 


gradient is maximum). 


along the direction Kx that the 


figure according to HMx, We want 


to compute ^ , 1^ being 


'"J. x 

the light intensity at M. (It is 


!M is normal to the plane 


figure I 



E 


LOS 0 


E^being the energy emitted the 
whole 4rt solid angle* 


4TT- f 











^ 3 Lti 6 
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As r i-S. and 

iet 9 


~b_\ _ t*_ Cjs^ p 
"5X **TT r* T 


^ „ 5l . ^ 3_ *m 26 d* 
I £ a 



and the plane Of the object + 

The experimental turves currently she* gradients 4 times as large sis 
the gradient: computed accord ins to the above formwlaj for the seme relati¬ 
ve position of the source and the object planet Thus some other pheno¬ 
mena must Interfere- 

The two main causes seem, to be that the lamps we use are far from 
being point light sources, and that the reflectivity of the surfaces 
varies with the angle of incidence of the light rays. 

(ii) Experimental exploration of the light intensity on a plane surface 

We used sheets of white snd uniform paper and took intensity cross- 
sections in various locations and directions, We found the following 
results: 

1) The nost important factor 
is ,ttae angular dependance of the lamp 


lamp radiation. Instead of a conti- 


L 





nudua decrease of the intensity from 


V 



\ 


N away along 3ffi (figure 2 ), we get 


a inS'xlimjL'i at C where the axis of the 


Lamp intersects the plane of the sheet. 


figure 2 
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2) Extreme values of the gradient are at points where the coe& 

t 

effect Is maximum and contribute to the gradient with the f 
same sign as the angular dependence of the lamp, They are of the 
order of: 


10 vidlog-unlts / cm 


_ itefcjcuafijjui 


Because of defocussing the inten¬ 
sity profiles across a perfect edge 
(figure 3 a) will look as in 35 ■ 

5 is the convolution of a stop And 
a circle (see figure 5 too)* 

We will evaluate the extent of *b 
for usual deviations from perfect 





-*—— 

i 

i 15 
1 



nlane of 


Let us suppose an edge normal to the sheet of paper in 0+ Light rays 
which enter the aperture end issue from points on the circle of diameter 
Op. (circle of confusion) converge toward- the image of B (respectively 
CKJ a nd A) . 
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Light rays apparently issued from, any point P in the plane of 
beat focus* converge after crossing the optical system* to a point 
image o£ P. If P is between A and B* the light rays will come from 
both aides of the edge- If P 4 OUtilde Afl* Its image will be the 
point of convergence of light rays coming from the same side o£ the 
edge. 

Thus the width of transitton is the width of the image of 
AE = % through the system. We haves 


J a a- _ = o, rj 

& - A f 


a being the diameter of the aperture and p the relative error in 
position with respect to perfect focus. 

If s' Is the distance aperture'image for a distance s aperture- 
object; 


i + I 1 

s s 1 £ 


fl focal distance 


and the corresponding ratio ima ge-s iz,e/ob J ec t-sfit 1 b - Thu* 




As s is relatively large„ the image of J is practically in the 


focal plane end f * a 1 * Thus i 



are: 


f * 10" 


a ■ from 2" down 


We will fotug at worst to 2" at 3 feet. Thus: 



The diameter of the photOcathode is 3". The ratio of the tnax ltib 1 
width of e line to the photoc* tliodft diameter is: 


f 


u 

9D 


The reioLmtlon of the pho tooa Chad e. being about 1000 points t £^wil1 


h&. «i l imo^t II grid-pointa. 


With B. Horn focussing program Horn 15665 * focua can he done 


to Icd at 3 feet. Thus P becomesi 



and d ■= 3 ■mu or 4 grid^pointa. 
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6 Results. Characteristic aapeuts of cd^cs . 


Vc found oiainly 3 different shapes of cross - sections noraial to 
edges: 

fl) Steps (figure 6a)i ——^— 


(11) Roofs (figure 6b). On each side of the edge the profiles have 
different constant slopes. Usually a antall effect. 

(til) EdgC-cffccts (figure 7)+ On the edge is a serial! bump of the in¬ 
tensity surface. __/\__ 

these three characters may he combined as In figure S. 
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figure 6 b 
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figure -6 
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SOME GENERAL CONSIDERATIONS ON DETECTION PROCEDURES 

The number of possible ec heme e for boundary detection is very 
large. However they all have In cocoon that noise discrimination is 
obtained jin part* by integrating seine function of the light inten¬ 
sities over some subset of the plane, <a one-dimensional (segment) 
or tifo-diwengtonal (rectangle at circle} neighborhood)* 

Around each point of the plane is centered such a neighbor¬ 


hood the intensity st any point P of 4 /^ can be written as the sue 
of a pure signal g(P) and a noise N(F), If we then apply a trans¬ 
form T to the intensity surface, noise discrimination will occur 
under the assumption that; 



when the area Eor length) of tends to infinity; i-e, the integral 
of the transform of the combined signal tends toward the integral 
of the transform of the pure signal» 

This is true for the transformsclone we have considered under 
the conditions that the noise ac r every point is Gaussian, has mean 
taro end a constant standard deviation; and provided that noise and 
signal are uncorrelated■ 

The transform must be such that the Integral reflects the pre“ 
sence of a discerntlnuity of the pure signal within the domain of 



, a discontinuity characteristic of rectilinear edges. 
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The transform can be linear or non"linear in intensity. In the 
rest of the thesis we will examine two methods; one linear and one 
strongly non'linear* We adopted the latter. It usee cutoffs Oh the 
result of proseasing of the Intensity surface by some differential 
operatoTi consequently the original brightness surface is transformed: 
into a 3"level surface, a drastic reduction of the original informa" 
tion. As a result, it cannot be optimally sensitive and linear 
predicates behave better In this respect* But it has One important 
advantage* namely: 

Contribution of Eurfaee defects to the integral over a 
a basic neighborhood is according to their extent not 
their amplitude. This gives to the method a good discri¬ 
mination against structure! + 

In linear eaethods, surface defects Bias the computation proportionally 
to the.tr extant and am&lItnde * which is often very large. This is 
particularly unfit for a line - verifier system: where high sensitivity 
must be obtained by integration over a relatively laTge neighborhoodi 
thus the number of points in the plane whose surrounding neighborhood 
includes the defect is large and the error is propagated far away 
from the defect itself* We have kept here the analysis of a linear 
method, because it sheds light on the properties of real edges and 
gives some idea of the theoretical soneiClotty limits. 

Up CO now we have been speaking of the local part of the proce¬ 
dure, Detection methods will then differ by: 

(‘i}> What the local stage returns for Information. 
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(ii> Efrnv thi s local Information is put together to reach a 
global answer to the detection quest ion,, i. e, the global set of I trie g. 

The local processing, may return likely "edge-pointent Then, at the 
Tic*fc stages «e vill look for an accumulation of edge-points along soma 
direction. 

Or it may 'return "edge-vectors'"], i„e. vectors tangent to the edges* 
Then the vectors vill string according to collinearity * 

Or the information carried along to the global proceas may be 
still more detailed; for example the edge-vectors may be accompanied 
by information about the type and amplitude of the discontinuity they 
reveal. We vill then string together only vectors of the same type 
and amplitude. 

We have listed these methods in an order corresponding to an 
increased noise filtration by the local-to- global process* The amount 
of nofss which can then be allowed to pass through the first noise 
filtering] [the local predicate) is correspondingly greater* i.e. 
fainter edges tan pass through and sensitivity improves. But the neces¬ 
sary amount of work increases* 

The method we have opted for in the line-verifier returns from 
the local stage with an edge-vector accompanied by the type and the 
"sign" of the discontinuity p the sign being defined according to the 
following: 
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Step 


Foaitive 


Negative 


Roof 



Edge--effect 

— V 


J\ 


It did not seem meaningful here to introduce several levels of amplitude 
because we are looking only for very small Signals anyway. 


With the following chapter we will start examining some linear 
transforms i, we will first see how they act on one dimensions i-e- 
along a profile jioncal to the edge. Then we will briefly describe a 
global method which we cried and how it failed. The last chapter 


will be devoted to the non-'it near method. 











LINEAR DETECTION PROCEDURES 


1 linear transforms 

li1 Function FI. first differences jjttjmafc fll 


Hie nvast usual intensity profile scxbsS an edge being roughly 
a step, let us consider the following function,, fl: 

A.t each point of the profile, we compute the difference 
between the average intensity after and before the point; 
both averages are taken Over a given length 2d (Id points). 


L (50 


Let MX) be the intensity profile; 

F1(X)^ -1~- ZL [t(X 4- L) - 
1 A Lit 

This amtaihts to taking the first 
differentos with an interval 26 ’ 
BIOS) = L[X + * J - M.X-A) 


4 nd averaging them over 2 d; 

J~ Pi (X+ ij - [l(x+4+l)- l £*-a-0] 

Fl (It) 


D1(J0 


l * 
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*K A 


4- 

- * 


h 

\ 



E-J 

. FJ (XI 

Figure ^ shows Lji Dl and PI fox an 
Ideal noiseless step. 

figure 9 

We will now discuss the sensitivity of detection on a single 



intensity profile. 
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(1) Sensitivity limit ifflEgllfl random noise 

Let us consider a flat intensity distribution with a random 
Gaussian noise superimposed> of standard deviation ^L. 

Fl> linear function of 4 a independant variables is normally distributed 
with average 0 and standard deviation: 

5 fi a jn xl- XL 

V TA /S' 

A Step h which we can detect must be such that: 

the value of Fl on an edge with step h E Fl* the noise. 

Thus i 

(I) h >> ix 

(ii) Sensitivity imposed by systematic effect 

a) Consrant alow gradient 

In order to discriminate an edge from, a constant slow slope,, 
the value of Fl on an edge muat be larger than its value for the 
maxinel slow slopes encountered. 

Let Qt be the slope. Then f 

Fl = 2 a*. 

A step h can be safely detected only if: 

(2) b>j> 2^aa figure 10 

b) £ojise,c:rent optimal value if, 

The maxima 1 values of t* encountered are of the order of 10 V!U</cm< 

To improve the sensitivity i should be increased according to (1) 
end decreased according to {2). Thus the optimal value occurs for: 

i A =■ 















2 % 


A V J s JX- 

At a distance of 3 feet. I cm is imaged into 40 grid - po int a „ and with 
a noise %h = l .2 v.u. j 

optimal ^ points 

With the normal distribution assumption* if w* then pet a cutoff on 
Fl at 2.6 times ^Fl* i.e* if we predicate: 

there is an edge <=» fl > 2.6 S^Fl 

we will reduce the probability of error in the absence of im ^dge 
to l%+ Detection will be successful at 50%foT an edge b yielding 
a value of Fl equal to the cutoff? i.e.3 

h = 2.6 

h = 1.6 v.u. 


c) Psfoc.uaAlag. 

Let us approximate the smeared intensity 
profile by straight lines as shown in 
figure II . Lot £ be the width of the e 
As we have aeen £ may currently be of 
the order of 6 points f For 4? 

F1(X) will have a peak value of h/2 
Instead of h? If we use the same 
cutoff On Fl as above, 50% detection 
will occur only for a step: 

b * 3*2 v*u+ 



figure 11 


Jl 




















The sensitivity is clearly unset£5factory t anti whatever the a 1 obaL 
d ec i s i an procedure* it cannot be conspirmuisly improved because of the 
presence of constant gradients on planes. 

One Is therefore lead tv think of criteria such as; there [tost be 
a local maKimyni of large amplitude of the function Fl on the considered 
profile- This amounts to considering differential operators of higher 
order> using second and third differences •„ these are the transforms 
which we will now consider. 


J-tl Function F 3 


LCX> 


Let LOO he an intensity profile and: 

D2 (X) - ~2L(X) + L{X+d) + L01 - i) 

I" A * 

F3iX) = J-JcZfK+i) - A>2(X*1> 

A _ *“ 


Lii 


D 2 (X) 


i , 

1 h 



1 

LJ 

A 


B 2 is the second differences with 
an interval A, F 3 is the difference 
between the mean of D 2 {X) Over ^ 
points after X and over ^ points 
before X. 

Figure 12 shows B 2 (X) and F 3 (X) 
for an idealised step-type edge, figure- 12 

Our reason for introducing F 3 and not simply taking a function which 
averages D 2 over an Interval is that we prefer to deal with a signal 
which is large rather than aero on the edge. 
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(1) Bensltivititi.Iigilt i mposed, by random. noise , 

With random noise,, D2 has mean zero and Vari&ftee; 

(« c^sl ) 2 + jl 2 + a* 

Sdz - JIT £l 

-f lL - * JXIL 

F3 on the edge equals 2h, 

Therefore a reliably detectable Stef h must verify: 

2b ?> 2 IT f L 
■Ja 

h »i! Sl 

(1U Systematic effect a 

a) F3 it obvious ly Serb for constant gradients. Fl is sero too for 
-any intensity Curve which stay be approximated by a parabola. So that 
tht angular dependence of the light SOotCC which is approximately 
parabolic* gives no contribution- 

b) The effect of defocussing depend* on the relative values of the 
■width ft of the line and of 4 + The limitation ot d being ouch less tight 
because we done suffer from constant gradients, we can assume that 

2A » & and that defocusaing does not affect us, 

(Hi) Choice of A 

The greater A the better the sensitivity. Our limitation will then 







com* from: 


3L 


a) The physical size of the object 


h) The light intensity dig tribetion on a plane hag to he 


possibly approximated by a second degree polynomial. 

Sow to compute oq q value of FI at a point Xj we need 4£ paints, 2 A on 
each side Of X, Thus 4A must not exceed, say 1/5 of the side of s 
cut rent cube* The Side of a current cube being about 1/5 of the seen* 
we must hsvet 


4A< 100 Q *, ppintg 


= 10 points 


optimal 


Then, if w* put a to toff on F3 corresponding to 2.6^3 1 we guarantee 
an error < 1 % on a flat distribution] *nd th* corresponding step h, 




h * 0,53 v*u 


1-.3 Function F2 


hut as an edge*effect or a roof, the function 


When the edge does not appear as a step. 



D2 (X) 


F3 is not effective* We must instead use 



eomcthing like the integral of the second 


F2 (K) 


differences t which expresses the radius of 



curvature. Let; 


D2CX) - -2L(X) + L(X+4) 4- LfX-Aj 


figute 13 







n 


D2 (X) = l _ f D2Qt+i) 

3. 4 i*-a 

F2 is the average of the second differences ever 2 A . Figure shows 


the resulting curve for a symmetric rOof sith slopes Of end -a. 


£>;,pL'.r-.tn,t ion of F2 for rand or. noise 


With pure random noisa, F2 has clean zero and s tand a rd deviation: 


J>2 = 


^ „ i/t J_L 


Ml* 


£ A 


rF£ - 



When dealing with an edge-effect, £ should be of the Order of 3 points. 
With a roof, aonething around 10 points Is a reasonable value for A. 

In the case of an edge-effect, the width b£ the bump is of the 
order of 3 to 10 points, under current conditions; by a onc-diambsional 
processing of a cross-section, we will discriminate, against irregula¬ 
rities. less than 3 points wide; therefore we will keep most structure, 
defects, which arc not distinguishable from an edge-effect. Our global 
decision procedure must then rely essentially on the comparison of 
pitraLLeL cross-sections. 
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2 A simple linear a Iqbal nrOcOss 


We tried these one-dimensional linear transforms within a comple- 
tely linear decision scheme. 

To be concrete we will assume that we are dealing with an edge 
of the step type, and that we apply to the intensity crosS'SecCions 
the function F3. 

2diT 

We want to know whether an edge lies 
between FI + ds and P2 + dx. We consider 
15 equidistant profiles between PI and F2 

and sum the values of F3 along a number figure 14 

of lines joining s point of FI Ids to a point of P2 X dx. 

We look for the largest of those sums and decide In favor of an edge 
when It Is greater than some prefixed threshold. 

An evaluation of t he. s.ensJ.,t.lvUy limit : 



The standard deviation on a sum 5 of 15 independant values 
Of F3 iSJ 

fs ■ /l5 - 2.0 v.u. 


A Cutoff at 2.$ S"s ** we usually du^ gives for the step detectable at 
yJ/ ° : 15 x 2 h = Z.fcJs 


h ■ 0.15 v.u. 
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This was programmed and tried. It was very good at finding very 
faint edges but the rate of errors on faces was very large 3 due to 
Surface defects* 
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A HOS-LINEAR DETECTION PROCEDURE 


As usual, we will describe ths method by distinguishing two 
of processingi the Ideal and the global* 


1> Iha -bated. Predicate 

Kc make a local decision based not on a single profile* but on a 
smalt number of parrsllel adjacent profiles. In other words* we consider 
a ndtfdv itiia perpendicular to the expected direction of the edge, end 
Che total decision process returns possible edge-segments which crose it 
almost vertically {for brevity we will always say vertical for the expec¬ 
ted direction of the edge although it can be any direction along which 
ue choose to look). 


t?e do this by computing a certain 
F of the Intensities within a basic 
neighborhood which Is a Small alon.”- 
gated rectangle which we slide along 
the strip* t^rae jqcal ma*ima of this 
function F indicate possible locations 
of almost vertical edge-segments. 



figure 15 


For a step, the function F is 


defined as follows: 
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compute the second differences (long every horizontal profile in the 
strip with an interval &. Figure 16 recalls the shape of the Curves. Thus* 
if we pet i> two-sided cutoff on the 


profile 


second differences (and assuming the 
step high enough), the distribution 
o£ cutoff points Shows two Appoints 
vide adjacent tectangles, one with 
all values below the negative cutoff, 
and the Other with all valuea above 
the positive cutoff (figure 16). 


The function F . is then eaiipu- 
stop r 


second 

differences 


(loti tl^-144 | 

a □ e- Qr Q Q 6- 4 + i + + 
+ + + 

DIM iaif«*4- + 

1 [[, (4ti+ + 4 4 


- 1 "■ ™ 

“ — — - - JJ o a ij * ij 

--— C-c-Jnc^G 

™-! -e — D £ O Cf -fl D tp 

- ■“ - --0 COCllt 
-~ _rQ 004 3 * g 


figure 16 

ted over e neighborhood 2 A, and eouals the between: 

B = (# 'positive' points - # 'negative' points) in the right half of 
the neighborhood and; 

L " (^ 'positive 1 points - # 'negative' points) in the left half. 

This function, shows a sharp 
extremum, on the edge (figure 17), 


The function F has the 
step 

following advantages: 

(i) The nee of a two-dt menstonal 
beads neighborhood increases the 
possible number of points entering 
in its computation, thus improving 
the noise discrimination. 




figure 17 
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(11) It accounts for the directional property oE the edge., i.e. the 
repetition of some accident in the 'vertical' direction. 

(ill) Tht weight of a surface defect is equal to the fttumber o£ points 
it covers* i+e- taxes UJ minimally. 

One difficulty Is the ''wings" shape of F * the relevant extreoum 

SLCp 

is framed by two 'parasite' extrema of amplitude half that at the edge. 
Thus some precaution must be taken to eliminate the ‘satellites'. Our 
first Idea was to compute the function $ which Is the sum of the two 
terms involved in cOmputtfi# i-e- & la: 

( positive points - negative points) in the tyfrole has la 

neighborhood. 

£ ■* L + R {notation as in the definition of F ^ ) 

step 

S is plotted below P : as it is aero Ort the edge but large on the 

step 

satellites, it offers a possibility of discrimination. 

As we will see* in the case of the line-verif let * this proved an 
unsatisfactory solution and had to be completed by same measure at the 
global level. 

Remarks i 1) The height of the Strip should be big enough to allow 

the 'directional property' of the edge to play its role; but small 
enough, so that for the given angular uncertainty of the edge which we 
allow, the horizontal coordinate of the edge varies negligibly while 




crossing the strip- (i.e. at most 1 grid-point) - 


2) In actuality, when computing F &t » we separate 
U£t and right half of the neighborhood by a narrow vertical corridor K 3 or 
4 point e wide, to allow for imperfect focO-S. 

3) The second differences are in fact the folio* 

wing function: t 

B2(K) - L<30 - L{K+4) - LCK+A+1) + L(X+!W) 
i.e. instead of taking twice the center value as in the usual second 
differences C2, we add the values at two nearby points. Then; 

< SH2) 2 - 4(Tl>* 

^D2 • 2^1, instead of for jj}2. 

j 

DZ is loss noisy. 


I) Statistical properties of the local function F atsp 


We define the probability of local detection as the probability that 

the value of at a given edge he greater than some prefixed threshold 

0 „ + AS we will see, the additional condition which we have introduced 

^atep 

to eliminate the satellite extrema of keeps t* 16 actual probability 

of local detection, equal to the one in this definition. 


We will compute ’'detection characteristic curves" which represent the 
probability of local detection aa a function of the signal* considering 
Gaussian noise only. This approximation will give us a starting point 
for fixing the parametera ,■ 





The parameter# which tear On the probabilities of detection are as 
followsi the 8lie of the haste rectangular neighborhood, the cutoff 
value for the aecond differencesi and the threshold for the function 
^step* c omputations constitute a simp Id combinatorial problem 
(see Appendix II) whose results fellow: 

1) Figure 19- (next page) shows the detect toft characteristics for various 
sizea of the neighborhood, expressed as the number of grid-pointa it 
centalna. 

To allow comparison* the same cutoff on the second differences 
has been used (i<e< rero) for all the curves , and the threshold on 
F^ haa been fixed to a value giving a probability of error of 
in the absence of an edge (signal. = 0) . (When made possible hy the 
available parameters t this ia the quantity we will keep constant through 
all characteristic curves! as it is more relevant for perforciance compa™ 
risons). The algcul Is measured in number of light Intensity standard 
deviations. 

The sensitivity of course improves with the Humber N of grid-points, 

A measure of the sensitivity is the signal for which detection Is 
successful. Figure 19 plots this quantity as a function of H;. sensitivity 
improves approximately #£ -Jk\ 

Geometric considerations limit the ai=c of the neighborhood. For the 
line-verifier* 70 grid-points, a rectangle of length 14 and height 5, 
seamed an adequate choice. 
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i 


DETECTION CHARACTERISTIC CURVES FOR VARIOUS SUES s 



figure IB 
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figure 1$ 



figure 20 
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MI numerical results * lei the remaining of the thesis , are based 
on a basic neighborhood containing 70 grid-points. 

2) tfext, we, vary the cutoff on the second differences - The sensitivity, 
defined in exactly the same manner as above, shows a fist extremum for 
a cutoff around 1.2 Standard deviation (figure 20 )■ With. JL * 1*2 v.u** 
the best we can approach this cutoff, with the digitization of the Inten¬ 
sities* Is by using a threshold of 1 v.u.. 

The resulting detection characteristic for the optimal choice of 
parameters is pLotted in figure i it has the usual 1^error for a 
jero-signal and 50 ^ detection occurs for a step: 

h = 0.56 v.u. 

This fixes the threshold on F to 0 _ _ T e 

ate P F step “ 

II) Effects of the introduction of a condition on the function 5 


The function £ defined on page 37 can be used to di6Criminate the 

canter extremum of F fron its satellites < 

step 

Both at the edge and at tha satallitee . we computed the probabilities 

that F be greater than 6 and S be sma11cr than some threshold 

Etc F F step 

Figure 21 plots those probabilities ii a function of the signal, for 










figure 21 
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various values of ft . { fj has been, fitted in eAch case to get \ f Q of 

v S F 

error for a zero - signal)■ 

For =■ 10 , the decrease in sensitivity becomes too great for 

5 

a line-verifier- town to 0 = 14* this decrease Is negligible. But then, 

u 

the probability of error by detection of the satellites haa an upper bound 
of 0.2, which is large- 

nonetheless we used a condition on 5* as it takes no time to compute 
and it does perform discrimination for a whole range of signals, 
those ^2rB v.u. ■ 

Reaark : more thorough investigation of this condition on S were -carried 

Cut- It seemed to shew that no detection system, even with different 
sensitivity requirements, could use ft alone. Reducing the error enough, 
involves reducing the probability of detection too much. Another alter¬ 
native which we would consider* If we were to build a general purpose 
detection system, is : look for the zero-crossings of the function & 
where L and R are both greater than some threshold. 
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2) The sloW nrftucdurc for th e line**verifier 

between the two points given as 

possible extremities of an edge, 25 

intensity profiles are taken* grouped 

by bands of 5 (figure 22)» The functions 

F end & are computed on each band 

step 

and the cutoff points are stored with 
the sign of _£ recorded *. 

The next step is to find a good vertical 

alignment of cutoff points with the same 

sign of F . Note that the cutoff 
step 

points are extrema of F along a band* so that we ere left with very 

3C€p 

few points at this Stage - from 1 to 4 per band depending on the state 
of the surface- i "vertical 1 inking"'' can then be very fast; usually 
the number of possible lines is just one, and the Localisation is precise 
(see figure 23 which shows a typical distribution of cutoff points). 

The search for an approximate vertical alignment is done as follows: 
we consider in turn various directions within the Angular uncertainty 
of the edger The cutoff points are projected along each direction* until 
at least 4 of them, each on a different band, yield approximately the 



figure 22 


sane direction 
































SECOND DIFFERENCES 



CUTOFF POINTS AFTER PROCESSING 
BY F r 













































47 

Let ua evaluate an upper hound af the probability that an edge 
following the satellite extrema be detected. The probability for a 
parasite extremal point on a band to appear is, As we sAw* at most 0.2 
(with = 14)+ As some that about 3 consecutive points on a band 
have that same probability of passing the cutoff^ Then the global 
probability of detection of the "wrong' Line is: 

2**3 »0+2^ = 0.024 


At the global stage a and with the surface imperfections, this Is too 
Large. So we do the following; note that Lines along parasite extrema 
follow points where F 0t h*S $ Sign opposite to the sign on the edge. 

At the global stage , we process separately the points whotc F ^ ia 
positive and the points where it ia negative; when each processing 
yields os Lines> we computed for each line* the sum of the values 
of F along it. For the real edged- this Sum is Largest factually 
it is about twice the others). This is a very reliable statistic because 
it is global. This additional work however is netOSSSry only when 
discrimination by a condition on S has failed. 


Tn order to evaluate the performance of the global procedure “ 
with Gaussian noise only- we used simulation. We generated atepa of 
various amplitude with a Gaussian noiae superimposed + For each given 
amplitude* 1000 such edges were generated and processed by the line- 
verifier equipped with the set of optimal parameters, acid the number 
Of successes recorded. We thus obtained an approximation to the global 



probability 



intensity standard-deviations 


figure 24 





4 ? 


detection characteristic (figure24 ), *nd the following result? 

With a probability of error of 0.3^ on a flat 
distribution, 50 ^ detection occurs for a step 
amplitude of 

i v . u . 


Remands - CO improve localization, whenever we find 4 points approximately 
vertically aligned we do not stop, using them to define the line, but 
we pinto up all points near enough CO this first approximation of the 
edge* and try to fit a line to chem; we thee throw out every point 
too remote fron this second definition of the line and checfc wether 
we are left with enough points !*&* at least 4, all on different bands* 


3) Roofs 

The overall procedure is the same 
except for a different function F- Indeed 
figure 25 shows a profile end the corres“ 
ponding second dif feractcee. A cutoff on 
the second differences will give* in an 
area containing a roof, a single vertical 


profile 







D■ * 

D 0 >0- 
- 0 * <2 


Strip of all positive Ot all negative points- 


figure 25 












so 

So we replace F by F the difference between, the number of pos 1- 

step roof 

five points end the number of negative points within s rectangular neigh¬ 
borhood of properly chosen else. The local predicate will simply be based 

on large extreme of F >■ 

roof 

If the second differences are computed with am Interval d > they 
are notrzero on a width 2 A, for an idealized roof. We chose a rectan¬ 
gular neighborhood of height 5 and width £(2 ^^ * 

$ 1 

The definition pf a proper cutoff on F ^ can h® done as follows: 

a flat notBy intensity distribution 1* generated, with a given standard 

deviation- Using the same cutoff of 1 v.u. on the second differences as 

we did for a atep, we applied the whole line-verlffcation process for 

roc-fa, with a given cutoff on ^ roo £■ The operation Is repeated a great 

number of times (^5000) and the number of wrong decisions (yes) recorded 

This is repeated for several cutoffs on F _ until one Is found which 

roof 

gives us a t most 1 error In a LOUD■ 

In fact, this procedure has a limited range of efficiency. Indeed 
the height of the peak of the second differences varies, for a A of B 
(which for geometrical reasons is about maximal) from average values 
of 0.6 v.u, Co masimals of 2 v.u. J clearly there is a whole range of 
roofs which we would not see. In fact, detection for those small values 
of the curvature ia very difficult, because there are some flat surfaces 
on which the curvature of the intensity surface ia as large IS on an edge 
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(for cwar^plc the translucent plastic cubes) > so that there is nu way of 
distinguishing the two. Detection then should be made by another type 
of analysis; i.e. the analysis of shape from shading of El-Horn (Horn 1970) 
Will not now handle this hut could reasonably be expected to extend to 
this problem. 


4) Jdge-effectB 

The procedure is the same as for roofs, with a different size of 
basic rectangular tieiglsborhood. Figure 26 shows the distribution of the 
second differences cutoff points for a typical edge-effect; the cutoffs 
on the second differences are respectively 2, 3 and 4 v-u* for a,b,d. 
This suggests s cutoff of 3 and a neighborhood of width 4» 

iOeflnltion of a cutoff on F „ is determined as in the case of 

effect 

roofs; by global simulation, the criterion being to make low enough 
the probability of error on a flat distribution. 



SECOND DIFFERENCES CUTOFF FQINTS ON AF EDGE-EFFECT 


FOR 



a} cutoff at 2 v*u + 


VARIOUS CUTOFFS 



h) cutoff at 3 v-u. 



() cutoff at 4 VtU f 


figure 2k 
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5) BaHdBEBSt line-verifier 

To teat tH& 1Ine-verifier * we started with cubes having relatively 
good surfaces (scene 1; figure 27 )* t.e* quite uniform and with little 
reflectivity. 

First we looked for a proper value of the threshold on F by trying 

the verifier on faces, starting with the value- of $ computed with 

Gaussian noise. As expected, we had to rel*C 0 * bet only from 16 "the 

F 

computed value- to 10. Then, out of about 30 tries* no failure was recor¬ 
ded + 

We then tried the verifier on the edges* -modifying the Lighting in order 
to get s wide range of different conditions. Failures occurred only by 
carefully adjusting the intensity on both Sides of the edge, using the 
information returned by the verifier as to which side was darker; we 
COuld not tell otherwise as typically edges were detected such that* on 
their profile# as displayed on the scope, nothing was visible by eye. 
Actually the range of postCions of a cube where failures occur is very 
small (translation of 1 n in 50 urn) and we could only find a position 
where failures Occurred only half of the time. The Localization was good 
and it was Insensitive CC displacements of the edge from its expected 
position within the ranges which we Expected; i.e.the extremities of the 
edge can be within +10 points from the expected. 


Very dim reflections of an edge against another surface were detected 



as cdgfcS - 


TO test the limits of functioning, of Che verifier, we set up two 

other scenes with very bad objects (scenes 2 and 3; figure 28 and 29). 

When keeping the same constants as in scene 1, we made errors most 

Of the time OP surfaces. Then, instead of raising which 

F 

would have diminish fed out sensitivity, we used 10 bands instead of 5, 
and required at least G of them to carry a cutoff point. Then we could 
record no failures on flat surfaces, although some of them practically 
showed texture; end*grain and wood-lines (note that the procedure Ignores 
every Line less than 3 points wide). The sensitivity On edges was quite 
similar to Chat described for scene 1+ 

EOMnded edges as In scene 2 were successfelly detected- Trying the 
verifier gcross an actual edge does not cause errors; t-e- the answer 
is il&- Roofs and edge-effects are detected as such (roofs appear essen* 
tially with the translucent plastic cubes) . 

We think that the line-verifier should adapt its constants depen* 
dfng on date made available by the higher level procedures; like the 
apace probably available for taking cross*aactions without Overlapping 
other edges, corners etc...; one could possibly use trapezoidal neighbor¬ 
hoods when one looks near corners. Bata about the state of the surfaces 
also could be used to fix the best values of the parameters for each 
particular verification. 

The computation time is about l/2 second, (the program is in HIEA,S)* 



This page is 
missing from 
the original 
document. 


This page is 
missing from 
the original 
document. 
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CONCLUSION 


w* haw* proposed a boundary dtttttian ; .ethod which. proved 
valuable for line verification. Ite noise discrimination is the 
result of three principles5 i,e, it uses siimmat i on p£ values of 
a non-1 inear function function of the intensities a *“d this function 
accounts for the geometry of edges* 

Et can detect an intensity step of 1 y.u. = 0*7% with 50% 
success. There are theoretically certain types of edges for which 
It fails {certain roofs and ml wed-type edges) but. their occurrence is 
rare end we were not able to find one in our experIrrents. 

The most Interesting property of the verifier is its very good 
filtering of surface irregularities, as shown by the success of 
experiments with practically textured surfaces. The speed of the 
verifier is satisfactory; emt of the time As spent in scanning. 

On defect Is that it will have trouble -distinguishing parallel 
edges loss than lb grid-points apart {twice the interval for the 
second differences) which in usual conditions if 1 -SjJ of the scene* 
The trouble thus incurred is linked to the relatively low resolution 
of the vidissector and the fact that one cannot escape a trade-off 
between sensitivity and observed space. 






5B 


The method could certainly be imp tocnc need as a general purpose 
line-finder, trading excellent sensitivity for time economy by using 
a looser grid and making summation ovet smaller pe £ fcJlborhood s . It 
would of course retain its insensitivity t« Surface defects which Is 
so essential for a practical edge"detector. 
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APPENDIX I 


Gradient at image for constant intensity at object 



Hie reflected intensity at the surface of the object is 


I- 


Let 


M be s point on the object end d^ Lj a surface element on the object 


surrounding Mi then JTJiaJ ie 
image of dA ; 


KHM K 


the light reflected and if dA^ la the 


d.J distance aperture - linage 
d Q t distance aperture-object 


If r & is the vector joining M to the center of the aperture, the light 
entering the aperture and issuing from, the object element dA^ is; 


A L 





solid angle defined by M and 
the aperture A + 


The image Intensity is thus; 

JU 


it. -list 

A . r* 

1 a u 

T /d \ A* - If 
- | Q.l a 

Fit ~ 

4n J%f 

















6G 


Using Che Chin lens relation;. 


+ 1 


f 


we get. 


Thus i 


d -f 
o 


J.= 

L 4tr 


■f 2 r . r 

a a 


-*i3 

r 

a I 


Let dx be an InfinitC£Lma1 vector on the object surface; to a second 
order approximation* we will compute the logarithmic intensity variation 
at the image* JQ** for e d;1 3 placement dx of the object points 

i 



We will calculate the separate terms: 


A , dr 

I 


l ( A* . r ) 

A . r . f. 

a a a a 

vector notmal to the aperture, 


n . d* 


n being a unit- 
a 



-jJTn - i< r B - ^7 “/s? 

= <r 2 ^ 2 r , + dx 2 ) 1 ' 2 - tr 3 ) 1 ^ 

3 -1 a 
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Given the orientation of n* and r* (Sec fixture >, vc have] 

“ “ 


d — - n . r and j 

a a a 


%(d & - £>=S-d o * n fl ♦ d« 


ThuS1 S3; -2 * 3] 

f f ^ , is 4- ]« 


J, < A 

l 1 

,^r 1 



Mow: 


r* *r) 


3 rr f 

and if IT is the distance from the optical axis to M; 


r a , A* 


r- 


Ttius 


^ ^ 

^ 

And *S iT fl . >T s 0 

“-—- ZTT - 

K "a***! 



™ - +■ *)” d3t 


1 

L 

* 


3^, „ 2 

fuis\ + 5 

(- (J ( K+*M* + H*! 1 

f ^ <U 

i J *. 

i. 1 ^ 


2. r^, dx _j - 3 x y A- 1 j 


4. 


*■ J 



vt 

The first otder term in ca ne e L a, If we write; 

J: 


J = J. 5 

L * 


U_ p. + -s s 

i ' J. -s 
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To a first order approximation, ~5 = ^ * 

a _ and gradients at the Image and at the object 

T' J„ 

are the; sane. 


Thus 


Wo obtain a typical magnitude of the gradient at the image for a cons¬ 
tant intensity at the object, by taking: 



idxl- l rt 

f - 10' 


1?[- 3- 

d o - 50 

Roughly3 

i 

s I 


3 . = 2 500 
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APPENDIX II 


Coaputation of detection characteristic curves 


I) Consider the signal of figure 31. 

We sample K points where amplitude is 
at each such point X, d (X) is noraial L y 
distributed with m-eaii 'l - and variance 1. 

He put a two-aided cutoff at on those 
K values; let 

u + he the number of points where d (X)? 
n_ the number of points where d(X)< - {^ 
We will evaluate 

= p^ohahi Hty that * n_J = k 


d(X) 


figure 31 


normal curve of error 


The tables of the normal distribu¬ 
tion give ua the probabilities p£ (reap, p^) 
that at a given point K where the mean fa 
d(X) be > Crespo < - 0^) + (figure 32), 



Lei 


p£ = prohabllity that £ <i£x} 




figure 32 


We will have (K - n + ™ ) points whore 

The probability Ir^k) will be a sum of trinomial terms. 
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K 

z, 

TV** k 


K 

a + 






■with 


n 


n. - k 

+ 


2) Me™ consider D2(2t) fop a step. 

Wft sample £ points right of C where 

the signal is and K points left of C where it is -t. 


and 


" (n + ' n - ) ii E ht ‘ (n + ' "-‘left 

* k - k' 

S - k + k* 


D2(S) 


T 


Then the probability that 


figure 33 




and 


N< K 


at C ii 


P - r. VU V ^' 1 

c M' * 1 ~ r 
lk^f> e F 
1 1+ k f f< & 5 

3) The cPTtiputatIon of the similar probability AC A (parasite extremum) 
is given fey the same formula except that in the right half the proba 1 - 


bilities are \ instead of it. 

* F 


pa - T v (k) Itth’J 

\W-W\>^F 

This was programmed with a little different organization in order to 


keep the computation time from getting too large 
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